Papers by Sergio Ortiz Rojas
ParaCrawl: Web-Scale Acquisition of Parallel Corpora (2020.acl-main)
Copied to clipboard
Marta Bañón, Pinzhen Chen, Barry Haddow, Kenneth Heafield, Hieu Hoang, Miquel Esplà-Gomis, Mikel L. Forcada, Amir Kamran, Faheem Kirefu, Philipp Koehn, Sergio Ortiz Rojas, Leopoldo Pla Sempere, Gema Ramírez-Sánchez, Elsa Sarrías, Marek Strelec, Brian Thompson, William Waites, Dion Wiggins, Jaume Zaragoza
| Challenge: | We describe methods to create the largest publicly available parallel corpora by crawling the web . parallel corpus is essential for building highquality machine translation systems . |
| Approach: | They describe methods to create largest publicly available parallel corpora by crawling web sites . they empirically compare alternative methods and publish benchmark data sets . |
| Outcome: | The proposed methods improve state-of-the-art results on common benchmarks, the authors show . the pipeline has been tested on Russian, Sinhala, Nepali, Tagalog, Swahili, and Somali . |
Bicleaner AI: Bicleaner Goes Neural (2022.lrec-1)
Copied to clipboard
| Challenge: | a new version of Bicleaner detects noisy sentences in parallel corpora . the tool is based on pre-trained transformer-based language models fine-tuned on a binary classification task. |
| Approach: | They propose to use Bicleaner AI to detect noisy sentences in parallel corpora . they use pre-trained transformer-based language models fine-tuned on a binary classification task . |
| Outcome: | The proposed tool improves translation quality and reduces manual cleaning steps. |
FastSpell: The LangId Magic Spell (2024.lrec-main)
Copied to clipboard
| Challenge: | Language identification is a crucial component in the automated production of language resources. |
| Approach: | They propose a language identifier that combines fastText and Hunspell to give a second opinion before deciding which language to assign to a text. |
| Outcome: | The proposed language identifier is based on a pre-trained language identifier and a spell checker. |